Desenvolvimento e Evidências de Validade do Inventário de Avaliação dos Cinco Grandes Fatores e Facetas de Personalidade (IACGF-F) / Development and Validity Evidence of the Big Five Factors and Facets Personality Assessment Inventory (PAIBFF-F)

A personalidade é um construto central na pesquisa psicológica, podendo ser definida como uma estrutura relativamente estável do ser humano que influencia seus comportamentos diante de acontecimentos diários. Este estudo objetivou desenvolver e obter evidências de validade baseadas na estrutura interna do Inventário de Avaliação dos Cinco Grandes Fatores e Facetas de Personalidade (IACGF-F). A Teoria dos Cinco Grandes Fatores de Personalidade foi utilizada como referencial teórico para elaboração dos itens. Para o estudo piloto, 150 sujeitos responderam à versão do instrumento composta por 151 itens e questionário sociodemográfico. O estudo final contou com 285 sujeitos com média de idade de 22,6 anos que responderam à versão do IACGF-F com 129 itens, além do questionário sociodemográfico. Foi realizado um conjunto de sete análises fatoriais exploratórias, estimação da fidedignidade, bem como calibração dos parâmetros dos itens a partir da TRI. A versão final do instrumento ficou composta por 103 itens distribuídos em cinco fatores com variação de cinco a seis facetas por fator. Foram encontrados bons índices de fidedignidade (alfas entre 0,85 e 0,96), além de bons índices de dificuldade e discriminação. Sugere-se a utilização do IACGF-F em pesquisas nas quais a avaliação mais detalhada das facetas se faz necessária.

Personality is a central construct in psychological research and can be defined as a relatively stable structure of human beings that influences their behavior in the face of daily events. The purpose of this study wasd to develop and obtain validity evidence based on the internal structure of the Inventory for Assessment of the Big Five Personality Factors and Facets (PAIBFF-F). The Big Five Personality Factor Theory was used as the theoretical framework for item development. For the pilot study, 150 subjects answered the initial version of the instrument, which consisted of 151 items and a sociodemographic questionnaire. The final study included 285 subjects with a mean age of 22.6 years who answered a version of the PAIBFF-F with 129 items and sociodemographic questionnaire. Seven exploratory factor analyses, reliability estimation, as well as calibration of the item parameters from TRI were performed. The final version of the instrument was composed of 103 items distributed in five factors with a variation of five to six facets per factor. Good reliability indices were found (alphas between 0.85 and 0.96), in addition to good difficulty and discrimination indices. We suggest the use of the IACGF-P in research in which a more detailed evaluation of the facets is required.

Nonparametric item response models: a comparison on recovering true scores / Modelos de resposta ao item não-paramétricos: comparando a recuperação de escores verdadeiros / Modelos de respuesta al item no-paramétricos: comparando la recuperación de puntuaciones verdaderas

Nonparametric procedures are used to add flexibility to models. Three nonparametric item response models have been proposed, but not directly compared: the Kernel smoothing (KS-IRT); the Davidian-Curve (DC-IRT); and the Bayesian semiparametric Rasch model (SP-Rasch). The main aim of the present study is to compare the performance of these procedures in recovering simulated true scores, using sum scores as benchmarks. The secondary aim is to compare their performances in terms of practical equivalence with real data. Overall, the results show that, apart from the DC-IRT, which is the model that performs the worse, all the other models give results quite similar to those when sum scores are used. These results are followed by a discussion with practical implications and recommendations for future studies.(AU)

Procedimentos não paramétricos são usados para adicionar flexibilidade aos modelos. Três modelos não paramétricos de resposta ao item foram propostos, mas não comparados diretamente: o Kernel smoothing (KS-IRT); a Curva Davidiana (DC-IRT); e o modelo semiparamétrico Rasch Bayesiano (SP-Rasch). O objetivo principal do presente estudo é comparar o desempenho desses procedimentos na recuperação de escores verdadeiros simulados, utilizando escores de soma como benchmarks. O objetivo secundário é comparar seus desempenhos em termos de equivalência prática com dados reais. De forma geral, os resultados mostram que, além do DC-IRT, que é o modelo que apresenta o pior desempenho, todos os outros modelos apresentam resultados bastante semelhantes aos de quando se usam somatórios. Esses resultados são seguidos de uma discussão com implicações práticas e recomendações para estudos futuros.(AU)

Se utilizan procedimientos no paramétricos para agregar flexibilidad a los modelos. Se propusieron tres modelos de respuesta al ítem no paramétricos, pero no se compararon directamente: Kernel smoothing (KS-IRT); la curva davidiana (DC-IRT); y el modelo bayesiano de Rasch semiparamétrico (SP-Rasch). El objetivo principal del presente estudio es comparar el desempeño de estos procedimientos en la recuperación de puntajes verdaderos simulados, utilizando puntajes de suma como puntos de referencia. El objetivo secundario es comparar su desempeño en términos de equivalencia práctica con datos reales. En general, los resultados muestran que, a excepción de DC-IRT, que es el modelo con peor desempeño, todos los otros modelos presentan resultados bastante similares a los obtenidos cuando se utilizan sumatorios. Estos resultados son seguidos por una discusión con implicaciones prácticas y recomendaciones para estudios futuros.(AU)

Cuestionario de conocimientos nutricionales aplicados en el deporte: Propuesta inicial de instrumento

El conocimiento nutricional es clave para la formación de hábitos alimentarios y en la modulación del comportamiento alimentario. La alimentación y nutrición son cruciales durante la adolescencia sobre todo en jóvenes deportistas. El objetivo de esta investigación fue analizar la validez teórica y los índices de discriminación y dificultad del cuestionario de conocimientos nutricionales aplicados en el deporte utilizando la teoría de respuesta al ítem en deportistas juveniles de 14 a 19 años. Este estudio instrumental se desarrolló en cinco fases: generación de ítems, revisión por panel de expertos, pilotaje, aplicación y depuración final. Participaron 261 adolescentes de 14 a 19 años e integrantes de disciplinas colectivas en selecciones Nacional y clubes profesionales. Se determinaron los índices de dificultad y de discriminación para cada uno de los ítems. Los ítems 1 (0,354) y 2 (0,285) del factor antes, 3 (0,315) y 6 (0,408) del factor durante, 7 (0,354) y 10 (0,408) del factor después, 3 (0,254) y 9 (0,231) del factor hidratación y, 2 (0,362) y 5 (0,323) del factor suplementación, fueron los que presentaron mayor grado de discriminación. El cuestionario de conocimientos nutricionales aplicados en el deporte está compuesto por 30 ítems divididos en cinco factores cada uno de ellos con seis ítems. La propuesta inicial del cuestionario es una herramienta valida teóricamente y con índices de dificultad y discriminación adecuados para evaluar el conocimiento nutricional en jóvenes deportistas. Su aplicación permite conocer potenciales brechas en conocimientos claves y diseñar estrategias educativas específicas para subsanarlas.

Nutritional knowledge plays a fundamental role in the formation of dietary habits and the modulation of eating behaviour. Nutrition and diet are crucial during adolescence, especially for young athletes. The purpose of this research was to analyse the theoretical validity and indices of discrimination and difficulty of the questionnaire on nutritional knowledge applied in sports using item response theory in youth athletes aged 14 to 19. This instrumental study was conducted in five phases: item generation, expert panel review, pilot testing, application, and final refinement. A total of 261 adolescents aged 14 to 19, who were members of national team and collective disciplines of professional clubs, participated. Difficulty and discrimination indices were determined for each item. Items 1 (0.354) and 2 (0.285) of the before factor, 3 (0.315) and 6 (0.408) of the during factor, 7 (0.354) and 10 (0.408) of the post factor, 3 (0.254) and 9 (0.231) of the hydration factor, and 2 (0.362) and 5 (0.323) of the supplementation factor showed the highest degree of discrimination. The questionnaire on nutritional knowledge applied in sports consists of 30 items divided into five factors, each with six items. The initial questionnaire proposal is a theoretically valid tool and with adequate difficulty and discrimination indices to evaluate nutritional knowledge in young athletes. Its application allows for identifying potential gaps in key knowledge and designing specific educational strategies to address them.

An application of cognitive diagnostic models in the evaluation of reading comprehension in Chilean university students

Introduction: Reading Comprehension skills are fundamental to the academic performance of university students. These abilities are not innate; therefore, systematic training is required before entering university. The main objective of this study was to evaluate the reading comprehension skills of Chilean University Students. Method: A sample of 579 students participated in the study, responding to four texts that comprise the Reading Comprehension Strategies for University Students (ELCU). An automated platform was used to apply and correct the test with immediate results and feedback. The tool allowed the use of a broad and representative sample of the various regions of Chile. The ELCU was developed using a cognitive diagnostic assessment (CDA) considering cognitive, metacognitive and linguistic strategies. The ana-lyses were performed using two different approaches: The Linear Logistic Test Model (LLTM) and the deterministic inputs, noisy "and" gate (DINA) model. Results: The rejection of the LLTM implies that the strategies do not differ in cognitive complexity (difficulty) while the adequate goodness of fit to the DINA model allows to characterise the students according to their reading abilities. Conclusion: The ELCU test provides reliable and valid information on the reading comprehension ability and metacognitive awareness of university students.

Introducción: Las habilidades de comprensión lectora son fundamentales para el rendimiento académico de los estudiantes universitarios. Estas habilidades no son innatas; por tanto, se requiere una formación sistemática antes de ingresar a la universidad. El objetivo principal de este artículo fue evaluar las habilidades de comprensión lectora de estudiantes universitarios chilenos. Método: En el estudio participó una muestra de 579 estudiantes que respondieron cuatro textos que componen las Estrategias de Comprensión Lectora para Estudiantes Universitarios (ELCU). Se utilizó una plataforma automatizada para aplicar y corregir la prueba con resultados y retroalimentación inmediatos. La herramienta permitió utilizar una muestra amplia y representativa de las distintas regiones de Chile. ELCU fue desarrollado mediante evaluación diagnóstica cognitiva (CDA) considerando estrategias cognitivas, metacognitivas y lingüísticas. Los análisis se realizaron mediante dos aproximaciones diferentes: The Linear Logistic Test Model (LLTM) y the Deterministic Inputs, Noisy "and" Gate (DINA) model. Resultados: El rechazo al modelo LLTM implica que las estrategias no difieren en complejidad cognitiva mientras que la adecuada bondad de ajuste al modelo DINA permiten caracterizar a los estudiantes según sus habilidades lectoras. Conclusión: La prueba ELCU permite obtener información confiable y válida sobre la capacidad de comprensión lectora y la conciencia metacognitiva de los estudiantes universitarios.

Sinonasal Outcomes Using Oral Corticosteroids in Patients with Chronic Rhinosinusitis with Nasal Polyps and Positive Sinonasal Cultures

Abstract Introduction Patients with chronic rhinosinusitis with nasal polyps (CRSwNP) and positive sinonasal bacterial cultures may be recalcitrant to topical therapy alone due to the additional local inflammatory burden associated with bacterial infection/colonization. Objectives To evaluate sinonasal outcomes in CRSwNP patients with a positive perioperative bacterial culture, who were treated with postoperative intranasal corticosteroids (INCS) alone versus INCS in combination with a short-term course of oral corticosteroids (OCS). Methods This is a retrospective chart review of CRSwNP patients. A total of 59 patients met inclusion criteria, including positive perioperative bacterial culture and treatment with INCS with or without concomitant use of OCS. Two cohorts were formed based on the chosen postoperative medical treatment; 32 patients underwent postoperative INCS alone, while 27 underwent INCS plus a ≤ 2-week course of OCS. The 22-item sinonasal outcome test (SNOT-22) scores and Lund-Kennedy scores (LKS) were assessed preoperatively, and at 2-week, 4-week, and 4 to 6 months after endoscopic sinus surgery (ESS). Results There were no statistically significant differences in postoperative sinonasal symptoms or endoscopic scores between the cohorts treated with INCS plus OCS versus those prescribed INCS alone (p > 0.05). Our regression model failed to demonstrate a relationship between the use of OCS and better sinonasal outcomes at 2-week, 4-week, and 4 to 6 months after ESS (p > 0.05). Conclusions Our study suggests that in a cohort of CRSwNP patients with recent bacterial infections, the postoperative use of combined OCS and INCS did not result in a statistical improvement of endoscopic and symptomatic outcomes over INCS irrigation alone. However, both treatment groups had a clinically significant improvement based on the Minimal Clinically Important Difference.

Reliability and validity of the 6-item UCLA Loneliness Scale(ULS-6)for application in adults / 南方医科大学学报

OBJECTIVE@#To evaluate the psychometric properties and applicability of the 6-item University of California Los Angeles (UCLA) Loneliness Scale (ULS-6) in adults.@*METHODS@#We conducted 2 surveys to assess the validity of different measurement scales and questionnaires. In Survey 1, a total of 1480 adults were measured using the UCLA Loneliness Scale (ULS), Patient Health Questionnaire-9 (PHQ-9) and Perceived Social Support Scale (PSSS), and the data were used for item analysis and assessment of the reliability, validity and measurement invariance. In Survey 2, UCLA Loneliness Scale was used for measurement in 652 college students, and the data were used for analysis of the criterion validity of ULS-6; 3 weeks later, 300 of the students were retested using ULS-6 to assess the retest reliability of the scale.@*RESULTS@#Item analysis suggested that the items in ULS-6 all had good discrimination power with discrimination indexes all above 0.775 (r=0.775-0.820, P < 0.001). Measuring only one dimension, ULS-6 had an internal consistency reliability of 0.891, a split-half reliability of 0.875, and a retest reliability of 0.726. The correlation coefficients of ULS-6 with ULS, ULS-8, PHQ-9 and PSSS were 0.882, 0.967, 0.528 and -0.532, respectively. The measurement invariances of ULS-6 across genders and age groups were all acceptable. Among the adult participants, the mean total score of ULS-6 was 12.97 ± 3.96; While only 20% of the adults had no loneliness, 80% of them exhibited varying degrees of loneliness, ranging from mild (39.6%) and moderate (25.7%) to intense (14.7%) feelings of loneliness.@*CONCLUSION@#The ULS-6 has good reliability, validity and applicability for measurement of loneliness in Chinese adults.

Cognitive Interview in the Search for Validity Evidence Based on Response Processes / Entrevistas Cognitivas na Busca de Evidências de Validade Baseadas no Processo de Resposta / Entrevistas Cognitivas en la Búsqueda de Evidencia de Validez Basada en el Proceso de Respuesta

Abstract Cognitive interviews can provide validity evidence for instruments based on item response processes; however, use of focus groups still prevails in Brazilian literature. Moreover, semantic analysis has only been considered when searching for validity evidence based on test content. This paper presents a proposal for qualitative data analysis based on cognitive interviewing, thus providing researchers with a protocol that enables best practices in carrying out this technique, and consolidating it in the Brazilian literature as an option to search for validity evidence based on item response processes. To conclude, we present some criticisms regarding current procedures for validity evidence based on test content and discuss some possibilities.

Resumo As entrevistas cognitivas podem fornecer evidências de validade para os instrumentos com base no processo de resposta aos itens. Na literatura brasileira, entretanto, o uso de grupos focais ainda prevalece. Além disso, a análise semântica tem sido considerada apenas na busca de evidências de validade baseada no conteúdo do teste. Esse manuscrito apresenta uma proposta para análise de dados qualitativos de entrevistas cognitivas. O objetivo é fornecer aos pesquisadores um protocolo que viabiliza as melhores práticas na realização desta técnica, consolidando-a na literatura brasileira como uma opção para busca de evidência de validade baseada no processo de resposta dos itens. Por fim, são apresentadas algumas críticas em relação aos atuais procedimentos de busca de evidências de validade baseadas no conteúdo e possibilidades são discutidas.

Resumen Las entrevistas cognitivas pueden proporcionar evidencia de validez para los instrumentos basados en el proceso de respuesta al ítem. En la literatura brasileña, sin embargo, aún prevalece el uso de grupos focales; además, el análisis semántico solo se ha considerado en la búsqueda de evidencias de validez basadas en el contenido de la prueba. Este manuscrito presenta una propuesta para el análisis de datos cualitativos de entrevistas cognitivas. El objetivo es proporcionar a los investigadores un protocolo que posibilite las mejores prácticas en la realización de esta técnica, consolidándola en la literatura brasileña como una opción para la búsqueda de evidencias de validez a partir del proceso de respuesta a los ítems. Finalmente, se presentan algunas críticas en relación a los procedimientos actuales de búsqueda de evidencias de validez en base al contenido y se discuten posibilidades.

European health literacy survey questionnaire short form (HLS-Q12): adaptation and evidence of validity for the Brazilian context

Abstract Health literacy (HL) refers to knowledge, motivation and skills to understand, evaluate and apply health information, enabling appropriate decision making in daily life on health care and health promotion. Studies show that HL is associated with several social determinants, health outcomes, and health promotion. In Brazil, studies on the thematic are still scarce. Thus, the present study aimed to adapt, seek evidence of validity, reliability and estimate the parameters of the items of the European Health Literacy Survey Questionnaire Short Form (HLS-Q12) for the Brazilian context. 770 individuals participated, recruited through advertisements in the media and social networks, 82.1% female, aged between 18 and 83 (M = 35.5, SD = 13.52), from 21 Federative Units of Brazil and the Federal District. The subjects answered the HLS-Q12 and a sociodemographic questionnaire. Exploratory factor analysis indicated a unifactorial structure with good psychometric characteristics (GFI = 0.98; CFI = 0.98; RMSEA = 0.08; RMSR = 0.07). Cronbach's alpha, Guttman's lambda 2 and McDonald's omega reliability indicators were equal to 0.87. We conclude that the HLS-Q12 is an adequate instrument to assess the level of HL in the Brazilian population.

Cuestionario de Gratitud-20 (G-20): evidências psicométricas e parâmetros de seus itens no Brasil / Gratitude Questionnaire-20 (G-20): psychometric evidences and parameters of their items in Brazil / Cuestionario de Gratitud-20 (G-20): evidencias psicométricas y parámetros de sus ítems en Brasil

Objetivou-se explorar os parâmetros psicométricos do Cuestionario de Gratitud por meio da Teoria de Resposta ao Item (TRI), utilizando o Modelo de Resposta Graduada. Para tanto, participaram 533 respondentes (M idade = 29,9), a maioria mulheres (67,7%). Inicialmente, checou-se a dimensionalidade da escala, que apoiou uma estrutura quadrifatorial (CFI = 0,99; TLI = 0,99). Os parâmetros dos itens foram realizados separadamente para cada fator, e os resultados indicaram que todos os itens discriminam adequadamente os participantes. Os itens do fator Reconhecimento de Dons exigiram uma maior quantidade de theta para serem completamente endossados e o fator Gratidão Interpessoal demandou menor quantidade de theta para ser a opção de reposta, talvez por ser melhor aceito socialmente. Estima-se que os objetivos do estudo foram alcançados, conhecendo evidências psicométricas de uma medida que avalia a gratidão numa perspectiva mais integradora, recomendando-se o seu uso em possibilidades futuras. (AU)

The aim of this study was to explore the psychometric parameters of the Gratitude Questionnaire through the Item Response Theory (IRT), using the Graduated Response Model. Therefore, 533 respondents participated (Mage = 29.9), mostly women (67.7%). At the beginning, we checked the dimensionality of the scale, which supported a quadratic structure (CFI = 0.99; TLI = 0.99). The parameters of the items were performed separately for each factor, and the results indicated that all items adequately discriminate participants. The items of the Gift Recognition factor required a greater amount of theta to be fully endorsed and the Interpersonal Gratitude factor required less amount of theta to be the answer option, perhaps because it is better accepted socially. It is estimated that the objectives of the study were reached, knowing psychometric evidence of a measure that evaluates gratitude in a more inclusive perspective, recommending its use in future possibilities. (AU)

Se objetivó conocer los parámetros psicométricos del Cuestionario de Gratitud por medio de la Teoría de Respuesta al Item (TRI), utilizando el Modelo de Respuesta Graduada. Participaron 533 sujetos (M edad = 29,9), la mayoría mujeres (67,7%). Inicialmente, se verificó las dimensiones de la escala, que apoyó una estructura cuadrifatorial (CFI = 0,99; TLI = 0,99). Los parámetros de los ítems fueron realizados separadamente para cada factor, y los resultados indicaron que los ítems discriminan adecuadamente a los participantes. Los elementos del factor Reconocimiento de Dons requirieron una mayor cantidad de theta para ser completamente endosados y el factor Gratitud Interpersonal demandó menor cantidad de theta para ser la opción de respuesta, tal vez por ser mejor aceptado socialmente. Se estima que los objetivos del estudio se alcanzaron, conociendo evidencias psicométricas de una medida que evalúa la gratitud en una perspectiva más integradora, recomendándose su uso en posibilidades futuras. (AU)

Burnout Syndrome Assessment Scale in Public Safety: Psychometric Parameters / Escala de Avaliação da Síndrome de Burnout na Segurança Pública: Parâmetros Psicométricos

ABSTRACT The burnout variable has been studied in different professions; however, it presents challenges in its measurement. The present study provides evidence of validity based on the internal structure of the Burnout Syndrome Assessment Scale in Public Security Workers (EASB-SP) and presents the estimation of item parameters through the Item Response Theory (IRT). A total of 10,885 public security agents from all states of Brazil participated in the study. The analyses indicated a three-factor structure, with adequate reliability indices and discrimination of the items. The Professional Fulfillment factor presented a lower theta value to be endorsed. The instrument was shown to be an adequate measure, with evidence of validity for the context of Brazilian public security.

RESUMO O Burnout tem sido uma variável estudada em diferentes profissões, embora com desafios em sua medida. O presente estudo apresenta evidências de validade baseada na estrutura interna da Escala de Avaliação da Síndrome de Burnout (EASB-SP) para a segurança pública, além de apresentar a estimativa dos parâmetros dos itens por meio da Teoria de Resposta ao Item (TRI). Participaram do estudo 10.885 agentes da segurança pública de todas as unidades federativas do Brasil. As análises indicaram uma estrutura tri-fatorial, com índices de fidedignidade e discriminação dos itens adequados. O fator de realização profissional indicou menor theta para ser endossado. O instrumento em questão apresenta-se como uma medida adequada e com evidências de validade para o contexto de segurança pública brasileira.

Tangeretin inhibits tumor stemness of non-small cell lung cancer by regulating PI3K/AKT/mTOR signaling pathway / 中国胸心血管外科临床杂志

@#Objective    To study the effect of Tangeretin on non-small cell lung cancer (NSCLC) and the tumor stemness, and to find the molecular mechanism of its effect. Methods    We used cell counting and cell cloning experiments to study the effect of Tangeretin on the proliferation of NSCLC cells in vitro. The effect of Tangeretin on the invasion of NSCLC cells was detected by transwell assay. We detected the effect of Tangeretin on the proliferation of NSCLC cells in vivo by nude mouse tumor-bearing experiment. The effect of Tangeretin on tumor stemness of NSCLC cells was detected by self-renew assay, and CD133 and Nanog protein expressions. The expressions of PI3K/AKT/mTOR signaling pathway-related proteins were detected by Western blotting (WB). Results    Tangeretin had a good inhibitory effect on the proliferation of NSCLC cells in vivo and in vitro. Cell counting experiment, clonal formation experiment and nude mouse tumor-bearing experiment showed that Tangeretin could inhibit the proliferation activity, clonal formation ability, and tumor size of NSCLC cells in vivo. Self-renew experiments showed that Tangeretin could inhibit the self-renew ability of NSCLC cells. WB experiments showed that Tangeretin inhibited the expressions of tumor stemness markers CD133 and Nanog in NSCLC cells. Tangeretin could inhibit the activation of PI3K/AKT/mTOR signaling pathway-related proteins in NSCLC cells, and the activation of PI3K/AKT/mTOR signaling pathway could partially remit the inhibitory  effect of Tangeretin on tumor stemness of NSCLC cells. Conclusion    Tangeretin can inhibit the tumor stemness of NSCLC cells, which may be related to the regulation of PI3K/AKT/mTOR signaling pathway.

Practice of refined cost management of medical service charging items based on hospital intelligent agent / 中华医院管理杂志

In recent years, public hospitals have been facing pressure from the reform of medical insurance payment methods. It is urgent to strengthen the operation and management of public hospitals. In June 2022, a tertiary public hospital utilized hospital intelligent agents to carry out refined cost management practices for medical service charging projects, sorted out medical service charging projects, designed management paths, and calculated project costs. The hospital conducted refined management on the cost of medical service charging items from three control dimensions of project unit cost with manpower, equipment and consumables, and two comparative directions with horizontal and vertical. The refined cost management practice not only pointted out the direction for global refinement cost control within the hospital, but also reduced the proportion of hospital consumption, which provided reference for improving the level of refined operation and management of public hospital hospitals.

Avaliação psicológica e avaliação da aprendizagem em larga escala: diretrizes para pesquisadores / Large-scale psychological assessments and learning assessments: guidelines for researchers / Evaluación psicológica y evaluación del aprendizaje a gran escala: directrices para investigadores

A avaliação psicológica (AP) e a avaliação educacional (AE) estão entre as contribuições mais importantes das ciências cognitivas e comportamentais para a sociedade atual, pois proporcionam importantes fontes de informações sobre os indivíduos e os grupos. O presente artigo objetivou apresentar diretrizes para os pesquisadores em relação a AP e a avaliação da aprendizagem em larga escala (AALEs). São discutidos os caminhos da AP em um mundo em crise sanitária devido a pandemia da Covid-19. Em termos das AALEs, são discutidos aspectos teóricos, metodológicos e analíticos que devem ser considerados pelos avaliadores e pesquisadores da área. Concluímos que a AP e AALE se relacionam na medida em que ambas cumprem a função social de identificar lacunas que merecem atenção, bem como aspectos funcionais que devem ser mantidos e incentivados. Outra importante característica é a exigência de constante aprimoramento técnico por parte dos avaliadores e pesquisadores. (AU)

Psychological assessment (PA) and educational assessment (EA) are among the most important contributions of cognitive and behavioral sciences to modern society. They provide important information about individuals and groups that are a part of the society. The aim of this article is to present guidelines for researchers regarding PA and large-scale learning assessments (LSLAs). The paths of PA in a world in health crisis due to the Covid-19 pandemic are discussed. In the context of LSLAs, we discuss theoretical, methodological and analytical aspects that must be considered by evaluators and researchers in the area. We conclude that PA and LSLAs are related to the extent that both fulfill the social function of identifying gaps that deserve attention, as well as functional aspects that must be maintained and encouraged. Another important characteristic is the requirement for constant technical improvement by both evaluators and researchers.(AU)

La evaluación psicológica (EP) y la evaluación educativa (EE) se encuentran entre las contribuciones más importantes de las ciencias cognitivas y del comportamiento hechas a la sociedad contemporánea, ya que brindan importantes fuentes de informaciones sobre los individuos y grupos que forman parte de ella. Este artículo tiene como objetivo presentar a los investigadores directrices sobre EP y la evaluación del aprendizaje a gran escala (EAGE). Se discuten los caminos de la EP en un mundo en crisis sanitaria por la pandemia del Covid-19. Con respecto a EAGE, se discuten aspectos metodológicos y analíticos que deben ser considerados por evaluadores e investigadores del área. Concluimos que la EP y la EAGE están relacionadas en la medida en que ambas cumplen la función social de identificar brechas que merecen atención, así como aspectos funcionales que deben ser mantenidos y fomentados. Otra característica fundamental es la exigencia de una mejora técnica constante, tanto por parte de los evaluadores, como de los investigadores.(AU)

Modeling social desirability in the Antisocial Self-Report (ASR-13) scores / Modelando a desejabilidade social na Escala de Auto-Relato de Comportamentos Anti-Sociais / Modelización de la deseabilidad social en los puntajes del Inventario Breve de Conductas Antisociales (ASR-13)

The Antisocial Self-Report (ASR-13) was developed to assess a general antisocial personality factor. However, because antisocial traits are socially aversive, the ASR-13 scores can be potentially contaminated by social desirability in high-stakes testing situations. In the present study, we performed an in-depth analysis of the ASR-13 to determine which items may be subject to socially desirable responding when used for data collection in prison settings. Participants were 324 college students, and 20 male prisoners. A Multiple Indicator Multiple Cause (MIMIC) model suggested three items were especially prone to eliciting socially desirable responding. We found evidence that prisoners likely attenuated their scores when rating items with content that is related to illegal behaviors. We discuss the implications of the findings, and how they help understand the latent processes that cause item responses to the ASR-13 inventory.(AU)

O Inventário Breve de Comportamentos Antissociais foi desenvolvido para avaliar um fator geral de personalidade antissocial. No entanto, como traços antissociais são socialmente aversivos, os escores do inventário podem acabar contaminados pela desejabilidade social em contextos de avaliação nos quais o indivíduo possui interesse em obter resultados favoráveis. No presente estudo, uma análise do ASR-13 foi realizada em relação a quais itens são suscetíveis às respostas socialmente desejáveis quando a coleta de dados é feita em ambientes prisionais. Os participantes foram 324 estudantes universitários e 20 homens privados de liberdade. O modelo Multiple Indicator Multiple Cause (MIMIC) sugeriu que três itens eram especialmente propensos a provocar respostas socialmente desejáveis. Evidências de que os participantes privados de liberdade atenuaram as suas pontuações em itens com conteúdo relacionado a comportamentos ilegais foram encontradas. Discutiu-se as implicações dos resultados e como ajudam a entender os processos latentes que causam respostas aos itens do ASR-13.(AU)

El Inventario Breve de Conductas Antisociales fue desarrollado para evaluar un factor general de personalidad antisocial. Sin embargo, como los rasgos antisociales son socialmente aversivos, los puntajes del inventario pueden verse contaminadas por la deseabilidad social en contextos de evaluación en los que el individuo está interesado en obtener resultados favorables. En el presente estudio, realizamos un análisis del ASR-13 en relación con qué ítems son susceptibles de respuestas socialmente deseables cuando la recolección de datos se realiza en entornos penitenciarios. Los participantes fueron 324 estudiantes universitarios y 20 hombres en situación de privación de libertad. El Modelo con Indicadores y Causas Múltiples (MIMIC) sugirió que tres ítems eras especialmente propensos a provocar respuestas socialmente deseables. Encontramos evidencias de que los participantes privados de libertad bajaron sus puntajes en ítems con contenido relacionado con conductas ilegales. Discutimos las implicaciones de los resultados y cómo ayudan a comprender los procesos latentes que provocan las respuestas a los ítems del ASR-13.(AU)

Teste de regulação de emoções: análise com a teoria de resposta ao item / Emotion regulation test: analysis with item response theory / Test de regulación de la emoción: análisis con teoría de respuesta al ítem

A regulação de emoções é uma habilidade relacionada à inteligência emocional que tem mostrado impactos importantes sob diversos aspectos da vida. Este trabalho teve o objetivo de analisar as pro-priedades psicométricas do Teste de Regulação de Emoções, com auxílio da Teoria de Resposta ao Item. O instrumento foi aplicado pela internet a 289 participantes, predominantemente jovens adultos, do sexo feminino e estudantes universitários. Os resultados informam sobre propriedades psicométricas do instrumento, que pode ser melhorado quanto à fidedignidade e no preenchimento de lacunas no contínuo de habilidades avaliadas pelo teste. Entretanto, foi adequado quanto ao equilíbrio entre os níveis de dificuldade dos itens e de habilidade dos respondentes, e proporcionou a compreensão dos aspectos que influenciam o aumento da dificuldade dos itens, com implicações clínicas e para a avalia-ção desse construto.

Emotional regulation is a skill related to emotional intelligence, which has shown important impacts on several aspects of life. This work aimed to analyze the psychometric properties of the Emotion Regulation Test based on the Item Response Theory. The instrument was applied over the internet to 289 participants, predominantly young adults, female and university students. The results inform about the instrument's psychometric properties, which can be improved in terms of reliability and in filling gaps in the skills continuum assessed by the test. However, it was adequate regarding the balance between the items' difficulty and the respondents' ability levels and provided information about aspects that influence the increase of the items' difficulty, which has clinical and assessment implications.

La regulación emocional es una habilidad relacionada con la inteligencia emocional, que ha mostrado importantes impactos en varios aspectos de la vida. Este trabajo tuvo como objetivo analizar las propiedades psicométricas de la Prueba de Regulación de la Emoción, con la ayuda de la Teoría de Respuesta al Ítem. El instrumento se aplicó vía internet a 289 participantes, predominantemente adultos jóvenes, mujeres y estudiantes universitarios. Los resultados informan sobre las propiedades psicométricas del instrumento, que pueden mejorarse en términos de confiabilidad y en llenar vacíos en el continuo de habilidades evaluadas por la prueba. Sin embargo, fue adecuado con respecto al equilibrio entre los niveles de dificultad de los ítemes y las habilidades de los encuestados y proporcionó una comprensión de los aspectos que influyen en el aumento de la dificultad de los ítemes, con implicaciones clínicas y para la evaluación de este constructo.

EFFECT OF SELECTED YOGIC PRACTICES AND PHYSICAL EXERCISES ON CARDIO RESPIRATORY ENDURANCE

Cardio respiratory endurance is the ability to exercise the entire body for extended periods of time without undue fatigue. A strong heart is necessary to supply oxygenated blood to the muscles of the body effectively. For the purpose of the study a group of 80 healthy adults were divided in four equals groups. Experimental groups 'A', 'B', 'C' and control group 'D' of 20 subjects each were compared in this study. The purpose of this study was to investigate the response of certain yogic practices and physical exercise programme on cardiorespiratory endurance and to assess their effectiveness as measured by nine minute run -walk test(AAPHER Health related physical ?tness test,1980).The analysis of data revealed that the three experimental groups trained by Exercise, yogic practices and combined exercise and yogic practices, showed signi?cant improvement in performance of Cardiorespiratory endurance but the mean gain achieved by combined exercise and yogic practices groups was higher than the other groups.

Item analysis of multiple-choice questions in anatomy for first year MBBS

Background: Multiple choice questions (MCQs) are preferred tools of assessment because of objectivity, ease of scoring and how each MCQ functions as an item can be understood by Item analysis. Aims and Objectives: The aim of the study was (i) to carry out item analysis of MCQs used in formative assessment to know the validity and (ii) to carry out a post validation item analysis of MCQ’s of 1st MBBS students in anatomy to use results for further actions. Materials and Methods: 45 MCQs were administered to 112 students of 1st M.B.B.S. as a formative assessment. Difficulty index and Discrimination index were calculated. Results: Mean difficulty index was 56.67 ± 22.09, and mean discrimination index was 0.35 ± 0.23. Distribution of easy, moderate, and difficult MCQ was 20, 67, and 13%, respectively. About 20% of MCQs were poor, 20% with acceptable discriminating index, 27% had good, and 33% MCQ were of excellent discrimination index. No item was negatively discriminating and all distractor were functional. Very easy and very difficult items had poor discriminating index. Conclusion: Most of items had moderate difficulty and good to excellent discrimination. Too easy and too difficult items showcased poor discrimination, no negatively discriminating item and absence of non-functional distractor suggest good quality framing of the MCQs.

The Basic Empathy Scale: evidence of internal structure in the brazilian context / Escala de Empatia Básica: evidências de estrutura interna no contexto brasileiro / Escala Básica de Empatía: evidências de estructura interna en el contexto brasileño

This study aimed to investigate evidence for the internal structure of the 20 item Basic Empathy Scale (BES-20), and verify the parameters of each of its items. The participants totaled 300 subjects from the community sample who answered both the BES-20 and demographic questions. The results indicated a two-factor measure involving: affective empathy (α = .84 and ω =.84) and cognitive empathy (α =.84 and ω =.84). Analyses using Item Response Theory demonstrated that the items of the BES-20 properly discriminated between participants, requiring low levels of latent trait for agreement/checking-off responses in each category. In addition, we developed a 10 item (short-form) version (BES-10) which when compared to the full version yielded equivalent psychometric parameters and information scores. Overall, both the BES-20 and BES-10 were confirmed as qualified for psychometric use in future studies to measure empathy in Brazil. (AU)

Este estudo objetivou conhecer as evidências da estrutura interna da Escala de Empatia Básica (BES-20) e os parâmetros de seus itens. Contou-se com a participação de 300 sujeitos da população geral que responderam a BES, além de perguntas demográficas. Os resultados indicaram uma solução composta por dois fatores para a medida com os fatores de empatia afetiva (α = 0,84 e ω = 0,84) e empatia cognitiva (α = 0,84 e ω = 0,84). Análises via Teoria de Resposta ao Item demonstraram que os itens da BES-20 discriminam adequadamente os participantes e exigem baixa quantidade de traço latente para o endosso de suas categorias de resposta. Além disso, forneceu-se uma medida reduzida composta por 10 itens (BES-10) com parâmetros psicométricos e taxas de informação comparável à versão com 20 itens. Conclui-se que ambas as versões da BES reúnem evidências que corroboram sua qualidade psicométrica, podendo serem utilizadas em estudos futuros que objetivem mensurar a empatia no Brasil. (AU)

Este estudio tuvo como objetivo conocer las evidencias de la estructura interna de la Escala Básica de Empatía (EBE-20) y los parámetros de sus ítems. Participaron 300 personas de la población general que respondieron la EBE-20 y preguntas demográficas. Los resultados indicaron una solución de dos factores: empatía afectiva (α = .84 y ω = .84) y empatía cognitiva (α = .84 y ω = .84). Los análisis a través de la Teoría de Respuesta al Ítem demostraron que los ítems de la EBE-20 discriminan adecuadamente los participantes, y requieren una cantidad baja de rasgos latentes para la aprobación de sus categorías de respuesta. Además, se proporcionó una medida reducida que consta de 10 ítems (EBE-10) con parámetros psicométricos y tasas de información comparables a la versión con 20 ítems. Se concluye que ambas versiones de la EBE recogen evidencias que corroboran su calidad psicométrica y pueden ser utilizadas en futuros estudios que tengan como objetivo medir la empatía en Brasil. (AU)

Assessing an assessment tool: Analysis of multiple choice questions on difficulty level and discrimination power, from an assessment in physiology

Background: Multiple Choice Questions (MCQs) or ‘‘items” are frequently used in medical education to assess students’ knowledge at the end of an academic session. However, item analysis has to be done to confirm their excellence. This piece of work was aimed to analyze test items in the subject of Physiology. In view of the fact that item analysis has never been conducted in our physiology department, thus this study was planned to assess the quality of MCQs and construct a viable question bank. Aim and Objectives: To evaluate the quality of MCQs used so as to develop a pool of valid items to update the question bank. Materials and Methods: Total of one hundred 1st year MBBS students were given 40 MCQs. Analysis was done with the item difficulty and item discrimination indices. Results: Difficulty indices (p) of 14 items were easy while about two MCQ were difficult and the remaining 24 of the items were within acceptable range. The discrimination index (DI) (D) for 40 items; one item showed negative discrimination, ten were having poor discrimination, whereas 11 were having excellent discrimination.Nine items were having acceptable, and nine items were having good discrimination. The DI exhibited slight positive correlation with difficulty index (r = 0.1575 P = 0.05). However, it was not statistically significant. Conclusion: The findings show that most of the items were falling in acceptable range of difficulty and discrimination level. It concludes that Item analysis is a very useful and necessary procedure to obtain valid Items from time to time.

Estructura Interna del Inventario Peruano de Mindfulness y Ecuanimidad / Internal structure of the Mindfulness and Equanimity Peruvian Inventory

Resumen El propósito del presente estudio es examinar la validez de constructo y consistencia interna del Inventario Peruano de Mindfulness y Ecuanimidad. Basado en el análisis factorial y la Teoria de Respuesta al Item (Modelo de Crédito Parcial y el Método de Escalabilidad de Mokken), se examinó la magnitud de los parâmetros y se estimò la varianza de cada uno de los items para contribuir en el constructo general de mindfulness. La muestra del estudio está compuesta por 602 adultos, estudiantes de tres instituciones acadêmicas de educación superior de Lima, Chiclayo y Chimbote en el Perú. Los resultados de estos análisis indican una estructura unidimensional del instrumento, en función a ocho items representados por los atributos de atención, consciencia, aceptación, juicio de valor, y ecuanimidad. Los indicadores de ajuste del modelo de factores oblicuos para los items seleccionados fueron satisfactorios: CEI = .982, RMSEA = .043 (IC90% = .029, .056), SRMR = .048, SB--2 (gl: 35) = 73.415 (p > 0.05).

Abstract The main purpose of this study is to report the construct validity and internal consistency of the Peruvian Inventory of Mindfulness and Equanimity. Based on the factor analysis and the Item response Theory (the Partial Credit Model and the Mokken Scale Analysis), the parameters magnitude was examined, and we estimated the variance of each item of the instrument that contribute to the general construct of mindfulness. The analyses were carried out on a sample of 602 adults, students from three educational institutions at the university level in the cities of Lima, Chiclayo, and Chimbote in Peru. The results of all the analyses performed on this peruvian sample suggest a unidimensional structure of this inventory, based on the eight items selected that include the abilities of attention, consciousness, acceptance, judgment, and equanimity. The goodness of fit index and adjusted goodness of fit index for the oblique factors were satisfactory: CEI = .982, RMSEA = .043 (lC90% = .029, .056), SRMR = .048, SB- -2 (gl: 35) = 73.415 (p > 0.05).